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Method for determining position of bjects In front of monitor 



Aalborg University, December 7tb 1999 

By Anders la Cour-Harbo and Jakob Stoustrup 



Introduction 



In many applications U is desirable lo operator an apparatus equipped with a monitor without using a 
keyboard or the like. Tt Is commonly known that a touch screen is a solution to this problem. The idea or 
die touch screen is that both information and "buttons- are located on the screen, and that the screen is 
sensitive to touch in two or three dimensions, that is the position on the screen - and possibly the pressure 
- of the touching object is determinable. We propose a method for acquiring that same information 
without the need for physical contact* Pressure is replaced by distance lo the screen. The method 
relies on the ability of (he screen to emit light (or indeed any kind of signal that can be modulated, like 
electromagnetic or acoustic waves) which can changes spatially and/or temporally. That is the emitted 
signal can change location on the screen and/or vary in time. This requirement is for instance fulfilled 
by any TV or computer monitor. W c propose two different approaches; one where pans of or the entire 
screen is continuously illuminated, and one where the objects are tracked as they move. 

Key words: Monitor, wavelet, touch screen, touch-free (screen). 



Description of the Idea 



We want to determine the position of one or more objects located in the immediate vicinity of the front of 
a monitor. In the following we will refer to one or more objects as "object". This object would typically 
be a finger or a pen, or another object of relatively little spatial extension in directions parallel to the 
monitor plane. We propose to do this by letting the monitor itself illuminate the object with some kind 
of signal, which depends of the capabilities of the monitor. This would typically be an electromagnetic 
signal within a limited range of frequencies. Alternatively a dedicated monitor for the purpose described 
could be used. Such a monitor would for instance emit auxiliary signals In predetermine, suitable fre- 
quency ranges, tucb as infra red and ultra-violet. Fur any monitor, at locations around iu a number of 
receivers is positioned. The emitted light Is reflected by the object onto these receivers, thus making it 
possible to determine the position of the reflecting object. 

There are basically two different ways of doing this. Either the timing of the updating of the image on 
the monitor can be used, or the distances between the reflecting object and receivers can be used. The 
former relies on the typical method for updating monitor images, which is sequential excitation of each 
pixel on the monitor. Whenever the pi acLs close to the object arc updated the change in the state of these 
pixel* (typically originating hi the beam of electrons used to excite the pixels) is reflected by the object 
onto the receiver*. Since it is known when each pixel is excited it is possible to determine the position of 
the reflecting object This method requires synchronization of the monitor image updating and the signal 
processing of the received signals. 

The other method is via measurements of the distances between the object and the receivers. If the 
absolute distances between die object and at least two (in some cases three) receivers are known, it 
is a relatively simple matter to determine the position. The distances can be found through timc-cC 
flight, triangular! nation, relative distances based on reflected intensity, or some other mean. The relative 
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SS^S 2^^™ VCr ' ^ "*-"» — 1 — * M — -can be 

^SL^.^^T-,, ^ mC *° d " * «*** *■ object in the tense that a number of pixel* in 
the vicin.ty of the object uWates. When the object moves the illumination follows. 

a^a^t C^dtrZlJSr^^ C °" b,ned With of the quality 

temBo^^U • determined by the positioning method chosen. By spatial and/or 

quality measurement. «P«n*le from s.gnal, from external sources and suitable for a 

Hierarchy of general proposals 

We propose: 

" ^^ZST*"* ^ POtili0 " ° r0nCWmQrC » «* - *°"« of a 

(a) A monitor capable of iiiun.inaUng the object with for Instance electromagnetic or acoustic 

(b) A number of receivers located around the monitor. 

z XTKST £32 1 wherc - "■-* s,BnaI 18 ~— * - — wh^h 

" £Ef^ — «- — by m_ of one 

4 " a^^; i ^ nedh,Pr0pOSal 1 ^^^-^.fi^i^wim theory to produce 

aNejeometncal shape whxch follow, . predefine course on the monitor ^dependent of^c 

6 ' ilK" " *f f ta •* nP ° Sal 3 ^ 4 where the illuminating pixels constitutes a fixed or vari- 
Ale geomcincal shape the movement of which depends on the reflecting object 

? ' " dCfinCd l " P^ 18 5*Kl6wherethe illumination signal is modulated spatial and/or 
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